METHOD OF, APPARATUS FOR IMAGE PROCESSING, 
AND COMPUTER PRODUCT 



BACKGROUND OF THE INVENTION 
5 1) Field of the Invention 

The present invention relates to a technology for image 
processing. 



2) Description of the Related Art 

10 In general, digital color photocopying machines apply an edge 

enhancement for improving sharpness of a character and a smoothing 
process for suppressing a halftone moire to image signals read by a color 
scanner. In order to maintain the consistency between the character 
sharpness and the halftone moire suppression, it is necessary to first 

15 extract image attributes and carry out an adaptive process, based on the 
extracted attributes, by switching between edge enhancement and 
smoothing or, alternatively, changing a degree of the edge enhancement. 

With a conventional technology, an edge amount is calculated 
from a luminance signal and an adaptive brightness/chrominance 

20 difference space filter processing is carried out on the color image signal 
based on the calculated edge amount. Such a technology is well 
disclosed in, for example, Japanese Patent Laid-Open Publication No. 
H1 0-421 52. However, in the case of color character-on-color 
background where the value of brightness in the background is similar to 

25 the brightness of the color character, the edge amount cannot be 



determined and hence, edge enhancement cannot be carried out. 

In another technology disclosed in Japanese Patent Laid-Open 
Publication No. H7-307869, a luminance signal L* and chromaticity 
signals a* and b* are used for distinguishing character areas from pattern 
5 areas. In yet another technology disclosed in Japanese Patent 

Laid-Open Publication No. 2000-278542, a luminance edge is determined 
from a luminance signal Y and a color edge is determined from color 
signals Cr and Cb. 

Generally, in a color scanner, an optical filter separates a 

10 reflected light from an original image into three basic colors RGB, namely, 
red, green and blue. A line sensor, which is formed from a 
charge-coupled device (CCD), reads each of the color lights. 
Consequently, the characteristic of the signal output from the scanner is 
determined according to the spectral sensitivity of the optical filter. Fig. 

15 15 illustrates spectral sensitivity of a typical RGB optical filter. As shown 
in Fig. 15, there is an overlapping of two or three spectral sensitivities at 
some specific wavelengths. Consequently, a response is output from a 
couple of colors for a light that has a wavelength in which such 
overlapping occurs. For instance, when an original green image, which 

20 has a spectral characteristic of 480-600 nanometer, is read by a scanner, 
only a response in G signal is expected to be output from the scanner as 
an output signal. However, because of the overlapping, a response is 
also output in R signal as well as in B signal. 

Consequently, even with the methods disclosed in the above first 

25 and second patent literatures, which are based on a chrominance 



difference (chromaticity), low frequency components due to the Rosetta 
pattern appear in the chrominance difference signals in an original color 
halftone image because of low precision of color separation of the signals 
output from the scanner. As a result, when an edge is detected in a 
5 character part on a color halftone, a comparatively large edge amount is 
detected even in a halftone dot and the low frequency components due to 
the Rosetta pattern appear in the edge amount of the halftone dot. This 
unevenness of edge enhancement results in a worsening of graininess. 
The low frequency components due to the Rosetta pattern also cause an 
10 error in judgment during halftone dot separation. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to solve at least the 
problems in the conventional technology. 

15 The image processing apparatus according to one aspect of the 

present invention includes an input unit that acquires a RGB signal 
corresponding to a color image, a conversion unit that converts the RGB 
signal into a CMY signal, an extraction unit that extracts an image 
attribute from the CMY signal, and a processing unit that applies, based 

20 on the image attribute, an adaptive image processing to the RGB signal. 

The image processing apparatus according to another aspect of 
the present invention includes an input unit that acquires a RGB signal 
corresponding to a color image, a first conversion unit that converts the 
RGB signal into a CMY signal, an extraction unit that extracts an image 

25 attribute from the CMY signal, a second conversion unit that converts the 



RGB signal into either of a luminance/chrominance difference signal and 
a lightness/chromaticity signal, and a processing unit that applies, based 
on the image attribute, an adaptive image processing to either of the 
luminance/chrominance difference signal and the lightness/chromaticity 
5 signal. 

The image processing apparatus according to still another aspect 
of the present invention includes an input unit that acquires a RGB signal 
corresponding to a color image, a first extraction unit that extracts a first 
image attribute from the RGB signal, a conversion unit that converts the 

10 RGB signal into a CMY signal, a second extraction unit that extracts a 
second image attribute from the CMY signal, and a processing unit that 
applies, based on the first image attribute and the second image attribute, 
an adaptive image processing to the RGB signal. 

The image processing apparatus according to still another aspect 

15 of the present invention includes an input unit that acquires a RGB signal 
corresponding to a color image, a first extraction unit that extracts a first 
image attribute from the RGB signal, a first conversion unit that converts 
the RGB signal into a CMY signal, a second extraction unit that extracts a 
second image attribute from the CMY signal, a second conversion unit 

20 that converts the RGB signal into either of a luminance/chrominance 
difference signal and a lightness/chromaticity signal, and a processing 
unit that applies, based on the first image attribute and the second image 
attribute, an adaptive image processing to either of the 
luminance/chrominance difference signal and the lightness/chromaticity 

25 signal. 



The image processing apparatus according to still another aspect 
of the present invention includes an input unit that acquires a RGB signal 
corresponding to a color image, a first conversion unit that converts the 
RGB signal into a CMY signal, a second conversion unit that converts the 
5 RGB signal into either of a luminance/chrominance difference signal and 
a lightness/chromaticity signal, a first extraction unit that extracts a first 
image attribute from the CMY signal, a second extraction unit that 
extracts a second image attribute from either of the 
luminance/chrominance difference signal and the lightness/chromaticity 
10 signal and a processing unit that applies, based on the first image 

attribute and the second image attribute, an adaptive image processing to 
the RGB signal. 

The image processing apparatus according to still another aspect 
of the present invention includes an input unit that acquires a RGB signal 

15 corresponding to a color image, a first conversion unit that converts the 
RGB signal into a CMY signal, a first extraction unit that extracts a first 
image attribute from the CMY signal, a second conversion unit that 
converts the RGB signal into either of a luminance/chrominance 
difference signal and a lightness/chromaticity signal, a second extraction 

20 unit that extracts a second image attribute from either of the 

luminance/chrominance difference signal and the lightness/chromaticity 
signal, and a processing unit that applies, based on the first image 
attribute and the second image attribute, an adaptive image processing to 
either of the luminance/chrominance difference signal and the 

25 lightness/chromaticity signal. 



The image processing method according to still another aspect of 
the present invention includes acquiring a RGB signal corresponding to a 
color image, converting the RGB signal into a CMY signal, extracting an 
image attribute from the CMY signal, and applying, based on the image 
5 attribute, an adaptive image processing to the RGB signal. 

The image processing method according to still another aspect of 
the present invention includes acquiring a RGB signal corresponding to a 
color image, converting the RGB signal into a CMY signal, converting the 
RGB signal into either of a luminance/chrominance difference signal and 

10 a lightness/chromaticity signal, extracting an image attribute from the 
CMY signal, and applying, based on the image attribute, an adaptive 
image processing to either of the luminance/chrominance difference 
signal and the lightness/chromaticity signal. 

The image processing method according to still another aspect of 

15 the present invention includes acquiring a RGB signal corresponding to a 
color image, extracting a first image attribute from the RGB signal, 
converting the RGB signal into a CMY signal, extracting a second image 
attribute from the CMY signal, and applying, based on the first image 
attribute and the second image attribute, an adaptive image processing to 

20 the RGB signal. 

The image processing method according to still another aspect of 
the present invention includes acquiring a RGB signal corresponding to a 
color image, extracting a first image attribute from the RGB signal, 
converting the RGB signal into a CMY signal, extracting a second image 

25 attribute from the CMY signal, converting the RGB signal into either of a 



luminance/chrominance difference signal and a lightness/chromaticity 
signal, and applying, based on the first image attribute and the second 
image attribute, an adaptive image processing to either of the 
luminance/chrominance difference signal and the lightness/chromaticity 
5 signal. 

The image processing method according to still another aspect of 
the present invention includes acquiring a RGB signal corresponding to a 
color image, converting the RGB signal into a CMY signal, converting the 
RGB signal into either of a luminance/chrominance difference signal and 

10 a lightness/chromaticity signal, extracting a first image attribute from the 
CMY signal, extracting a second image attribute from either of the 
luminance/chrominance difference signal and the lightness/chromaticity 
signal, and applying, based on the first image attribute and the second 
image attribute, an adaptive image processing to the RGB signal. 

15 The image processing method according to still another aspect of 

the present invention includes acquiring a RGB signal corresponding to a 
color image, converting the RGB signal into a CMY signal, converting the 
RGB signal into either of a luminance/chrominance difference signal and 
a lightness/chromaticity signal, extracting a first image attribute from the 

20 CMY signal, extracting a second image attribute from either of the 

luminance/chrominance difference signal and the lightness/chromaticity 
signal, and applying, based on the first image attribute and the second 
image attribute, an adaptive image processing to either of the 
luminance/chrominance difference signal and the lightness/chromaticity 

25 signal. 



The computer product according to still another aspect of the 
present invention realizes the methods according to the present invention 
on a computer. 

The other objects, features and advantages of the present 
5 invention are specifically set forth in or will become apparent from the 
following detailed descriptions of the invention when read in conjunction 
with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 Fig. 1 is a block diagram of an image processing apparatus 

according to a first embodiment of the present invention; 

Fig. 2 is a block diagram of the edge amount calculating unit 
shown in Fig. 1; 

Fig. 3A to Fig. 3D illustrates a four-direction linear differential 

15 filter; 

Fig. 4 is a block diagram of the filter processing unit shown in Fig. 

1; 

Fig. 5 illustrates a smoothing filter; 
Fig. 6 illustrates a Laplacian filter; 
20 Fig. 7 is a block diagram of an image processing apparatus 

according to a second embodiment of the present invention; 

Fig. 8 is a block diagram of an image processing apparatus 
according to a third embodiment of the present invention; 

Fig. 9 is a block diagram of the image area separating unit shown 
25 in Fig. 8; 

8 



Fig. 10 is a block diagram of the filter processing unit shown in 

Fig. 8; 

Fig. 11 is a block diagram of the smoothing unit shown in Fig. 10; 
Fig. 12 is a block diagram of an image processing apparatus 
5 according to a fourth embodiment of the present invention; 

Fig. 13 is a block diagram of an image processing apparatus 
according to a fifth embodiment of the present invention; 

Fig. 14 is a block diagram of the image area separating unit 
shown in Fig. 13; and 
10 Fig. 15 illustrates spectral sensitivity of a typical RGB optical filter. 



DETAILED DESCRIPTION 

Exemplary embodiments of a method, an apparatus, and a 
computer product according to the present invention are explained with 

15 reference to the accompanying drawings. The embodiments are 

described in the sequence of first embodiment, second embodiment, third 
embodiment, fourth embodiment, and fifth embodiment. In the following 
descriptions of embodiments, an image processing apparatus is applied 
to a color photocopying machine. 

20 Fig. 1 is a block diagram of an image processing apparatus 

according to a first embodiment of the present invention. The image 
processing apparatus comprises a scanning unit 1, a scanner y correction 
unit 2, a filter processing unit 21, a color correction unit 3, a BG (black 
generation)/UCR (undercolor removal) unit 4, a printer y correction unit 5, 

25 an intermediate tone processing unit 6, a printing unit 7, a color 



converting unit 22, and an edge amount calculating unit 23. 

The scanning unit 1 optically reads an original color image and 
photoelectrical^ converts the original color image to an 8-bit (0 to 255) 
digital color image signal. The scanning unit 1 then carries out a widely 
5 known shading correction and outputs an rgb (red, green, blue) signal to 
the scanner y correction unit 2. 

The scanner y correction unit 2 uses a color look-up table (LUT) 
or the like and converts the rgb signal received from the scanning unit 1 
into an RGB signal, which is a density signal, and outputs the RGB signal 
10 to the filter processing unit 21 and the color converting unit 22. 

The color converting unit 22 converts the RGB signal received 
from the scanner y correction unit 2 into a CMY signal and outputs a C 
signal and an M signal to the edge amount calculating unit 23. The edge 
amount calculating unit 23 detects the edge amount of the C signal and 
15 the M signal received from the color converting unit 22 and outputs edge 
amounts of the C signal and the M signal to the filter processing unit 21 . 

The filter processing unit 21 carries out a filtering process on the 
RGB signal received from the scanner y correction unit 2 in accordance 
with the edge amounts received from the edge amount calculating unit 23, 
20 and outputs the post-filter-processed RGB signal to the color correction 
unit 3. 

The color correction unit 3 converts the post-filter-processed RGB 
signal received from the filter processing unit 21 into the CMY (cyan, 
magenta, yellow) signal and outputs it to the BG/UCR unit 4. In the 
25 color correction unit 3, the color correction process is carried out based 



on following equations: 

C = a11xR + a12xG + a13xB + pi 
M = a21xR + a22xG + a23xB + p2 

Y = a31xR + a32xG + a33xB + p3 ... (1) 

5 where a11 through a33 and pi through p3 are preset color correction 
coefficients and the output CMY signal is an 8-bit (0 to 255) signal. 

The BG/UCR unit 4 generates, based on the CMY signal received 
from the color correction unit 3, a K signal (BG - black generation) which 
has a black component, carries out under color removal (UCR) from the 
10 CMY signal, and outputs a CMYK signal to the printer y correction unit 5. 
In the BG/UCR unit 4, the generation of the K signal and the under color 
removal from the CMY signal are performed based on following 
equations: 

K = Min (C,M,Y) x p4 
15 C = C-K x p5 

M' = M-K x p5 

y = Y-K x p5 ... (2) 

where Min(C,M,Y) indicates the minimum values of the CMY signal, p4 
and p5 are preset coefficients, and the signal is an 8-bit signal. 

20 The printer y correction unit 5, with the help of the look-up table, 

carries out a y correction process for each color of the received CMYK 
signal in order to make the colors compatible with the y attribute of the 
printer, and outputs the scanner y-corrected CMYK signal to the 
intermediate tone processing unit 6. 

25 The intermediate tone processing unit 6 carries out a pseudo 



halftone process such as the widely known dither process or an error 
diffusion process and the like on the scanner y-corrected CMYK signal 
received from the printer y correction unit 5, and outputs the 
pseudo-halftone CMYK signal to the printing unit 7. The printing unit 7 
5 carries out a series of imaging processes on the post-pseudo-halftone 
CMYK signal received from the intermediate tone processing unit 6. 

The color converting unit 22, the edge amount calculating unit 23, 
and the filter processing unit 21 , which are the features of the present 
invention, are explained in detail next. 

10 The color converting unit 22 converts the RGB signal, which is 

received after y correction by the scanner y correction unit 2, into CM 
(cyan, magenta) signals and outputs the CM signals to the edge amount 
calculating unit 23. The conversion from RGB to CM is carried out in 
accordance with the expression (3) given below. 

15 C = <x11'xR + a12'xG + a13'xB + pi' 

M = a21'xR + a22'xG + a23'xB + (32' ... (3) 

where a11' to a23' and pi' and p2' are preset coefficients. 

The optimum value of ot11' to cc23' and pi' and p2' in the above 
expression (3) will also vary according to the hue of the original image. 

20 It is not quite possible to use the different coefficients for each type of the 
original image. Hence, it would be ideal if the values of cc1 1 ' to oc23' and 
p1' and p2' could be changed according to the original image type mode 
(such as, print image mode, photocopy image mode (generation mode), 
photographic printing paper image mode, etc.) in order to separate the 

25 scanner y-corrected RGB signal with high precision into a CMY signal, 



which is the processing color of the original image. 

For instance, in the case of the print image mode, a coefficient 
can be used that will yield high color separation precision for a typical 
printing ink. Alternatively, in the case of the photocopying image mode, 
5 a coefficient can be used that will yield high color separation precision for 
the toner of the photocopying machine. It is also possible to use the 
coefficients a11 to a23 and p1 and p2 in the expression (1), irrespective 
of the original image type mode. However, the color separation 
precision for an original print image will deteriorate. 

10 The edge amount calculating unit 23 calculates the edge amount 

from the CM signals received from the color converting unit 22. Fig. 2 is 
a block diagram of the edge amount calculating unit 23 shown in Fig. 1 . 
The edge amount calculating unit 23 includes edge amount calculating 
filters 51 C and 51 M, maximum value selectors 52C and 52M, constant 

15 multipliers 55C and 55M, a maximum value selector 53, and a LUT 
(look-up table) 54. 

The edge amount calculating filters 51 C and 51 M have an 
identical hardware structure. The edge amount calculating filter 51 C 
and 51 M calculate for a C signal and an M signal, respectively, 

20 four-direction absolute edge values, as shown in Fig. 3A to Fig. 3D, by a 
linear differential filtering process. 

The maximum value selectors 52C and 52M select a maximum 
value each of the quadratic edge amounts for the C signal and the M 
signal, respectively, and output the maximum values of the edge amount 

25 to the constant multipliers 55C and 55M. The constant multiplier 55C 



multiplies the maximum value of the edge amount of the C signal by a 

constant 1 and outputs the product to the maximum value selector 53. 

The constant multiplier 55M multiplies the maximum value of the edge 

amount of the M signal by a constant 2 and outputs the product to the 
5 maximum value selector 53. The constants 1 and 2 are constants that 

are used for adjusting the edge amounts of the C signal and the M signal. 
The maximum value selector 53 selects the greater value of the 

(edge amount of C signal x constant 1) and (edge amount of M signal x 

constant 2) and outputs the value to the LUT 54. 
10 The LUT 54 converts the (edge amount of C signal x constant 1) 

value or the (edge amount of M signal x constant 2) value received from 

the maximum value selector 53 such that the edge amount achieves the 

desired filtering strength. 

The filter processing unit 21 carries out, based on the edge 
15 amount received from the edge amount calculating unit 23, an adaptive 

filtering process on the RGB signal received from the scanner y correction 

unit 2 and outputs the filtered RGB signal to the color correction unit 3. 

Fig. 4 is a block diagram of the filter processing unit 21 shown in Fig. 1 . 
The filter processing unit 21 includes smoothing filters 61 R, 61 G, 
20 and 61 B, Laplacian filters 62R, 62G, 62B, multipliers 64R, 64G, 64B, and 

adders 65R, 65G, 65B. 

The smoothing filters 61 R, 61 G, and 61 B have an identical 

hardware structure and carry out, respectively, on the R signal, the G 

signal, and the B signal input from the scanner y correction unit 2 the 
25 widely known smoothing filtering process by the smoothing filters in the 



form of the filter coefficients shown in Fig. 5 and output the 
smoothing-filtered R signal, G signal, and B signal respectively to the 
Laplacian filters 62R, 62G, 62B and the adders 65R, 65G, 65B. 

The Laplacian filters 62R, 62G, and 62B carry out, respectively on 
5 the post-smoothing-filtered R signal, G signal, and B signal input from the 
smoothing filters 61 R, 61G, and 61 B the widely known Laplacian filtering 
process by the Laplacian filters in the form of the filter coefficients shown 
in Fig. 6 and output the filtered R signal, G signal, and B signal 
respectively to the multipliers 64R, 64G, and 64B. 

10 The multipliers 64R, 64G, and 64B multiply the R, G, B signals 

input respectively from the Laplacian filters 62R, 62G, and 62B with the 
edge amount input from the edge amount calculating unit 23 and output 
the resulting product respectively to the adders 65R, 65G, and 65B. 

The adders 65R, 65G, and 65B add the output from the multipliers 

15 64R, 64G, and 64B and the output from the smoothing filters 61 R, 61 G, 
and 61 B, and output the resulting value to the color correction unit 3. 

To sum up, according to the first embodiment of the present 
invention, the color converting unit 22 converts the RGB signal to the 
CMY signal. The edge amount calculating unit 23 calculates from the 

20 CM signals, which have a high color separation precision, the edge 

amount as the image attribute. The filter processing unit 21 carries out, 
based on the edge amount, an adaptive filter process on the RGB signal. 
Consequently, an increased edge amount for color character-on-color 
background can be obtained as compared to the edge amount calculated 

25 from the scanner y-corrected RGB signal (or the luminance signal or the 



chrominance difference signal) that has a low precision of color 
separation. As a result, sufficient edge enhancement can be achieved. 

To be more specific, in the scanner y-corrected RGB signal, when 
green characters are on a red background, the background, apart from 
5 the red signal, has other color signals as well. Similarly, the characters, 
apart from the green signal, have other color signals as well. Therefore, 
even if the edge amount is extracted from the chrominance difference 
signals, it may not sufficient. On the contrary, in the CM signals, when 
magenta characters are on a cyan background, the background has only 

10 C signal (the level of M signal is practically negligible) and the characters 
have only M signal (the level of C signal is practically negligible). 
Therefore, it is as if magenta characters are on a white background and, 
as a result, sufficient edge amount can be extracted. 

Further, in the first embodiment, the Y signal is not used while 

15 calculating the edge amount, although it may be used for calculating the 
edge amount. If the Y signal is used, an edge amount calculating filter 
51 for Y signal, and a maximum value selector 52 for Y signal would be 
required in Fig. 2. However, generally, the Y signal is of a bright color 
and therefore the requirement for edge enhancement for visualization is 

20 considered low. Hence, CM signals are sufficient for the calculation of 
the edge amount. 

Further, in the first embodiment, the edge amount of C signal and 
the M signal is calculated independently. However, it is also possible to 
combine the C and M signals, or C, M, and Y signals, and calculate the 

25 edge amount from a single signal using signals such as (C+M)/2, max 



(C,M,Y). In this case, however, the precision is inferior to the method in 
which the edge amount is calculated for individual signals. However, the 
hardware requirement can be reduced as only a single circuit is 
necessary for the edge amount calculation. 
5 The image processing apparatus according to a second 

embodiment of the present invention is explained next with reference to 
the block diagram shown in Fig. 7. The second embodiment has the 
same components as the first embodiment shown in Fig. 1. However, 
the positions of the color correction unit 3 and the filter processing unit 21 

10 are interchanged in the second embodiment. In the first embodiment, 
filtering process is carried out for the RGB signal. However, in the 
second embodiment, filtering process is carried out for the CMY signal. 

A color correction unit 3 converts the RGB signal received from 
the scanner y correction unit 2 into the CMY signal and outputs the CMY 

15 signal to the filter processing unit 21. While the conversion from the 

RGB signal to the CMY signal by the color correction unit 3 is carried out 
so that the colors match with the color reproduction range of the output 
printer, the conversion from the RGB signal to the CMY signal by a color 
converting unit 22 is carried out so that a low precision color separation 

20 signal such as the RGB signal is converted to a high precision color 
separation signal such as the CMY signal. 

The filter processing unit 21 carries out, based on an edge 
amount input from an edge amount calculating unit 23, an adaptive 
filtering processing on the CMY signal received from the color correction 

25 unit 3, and outputs the filtered CMY signal to a BG/UCR unit 4. 



Consequently, in the image processing apparatus according to the 
second embodiment also, the edge amount is calculated not from the CM 
signals output from the color correction unit 3, but from the CM signals 
output from the color converting unit 22. As a result, a highly precise 
5 edge amount can be obtained. 

Further, as explained in the first embodiment, at the risk of 
deterioration of color separation precision, the conversion coefficients 
a11 to a23 and pi and p2 in the expression (1) can be used irrespective 
of the original image type mode. In this case, the color converting unit 

10 22 and the color correction unit 3 in Fig. 7 can be combined into one. 
Therefore, the hardware requirement is reduced since only one circuit is 
required for the conversion of the RGB signal to the CMY signal. 

The image processing apparatus according to a third embodiment 
of the present invention is explained next with reference to Fig. 8 through 

15 Fig. 11. Fig. 8 is a block diagram of an image processing apparatus 
according to a third embodiment of the present invention. The image 
processing apparatus shown in Fig. 8 has a second color converting unit 
31, a third color converting unit 33, and an image area separating unit 34 
in addition to the parts in the image processing apparatus shown in Fig. 1. 

20 The parts in Fig. 8 that are identical to the parts in Fig. 1 are assigned the 
same reference numerals except for the filter processing unit which is 
assigned the reference numeral 21 in Fig. 1 but is denoted by the 
reference numeral 32 in Fig. 8. Only the parts that are peculiar to the 
third embodiment, namely, the second color converting unit 31 , the third 

25 color converting unit 33, the filter processing unit 32, and the image area 



separating unit 34 are explained in this section. 

Fig. 9 is a block diagram of the image area separating unit 34 
shown in Fig. 8. The image area separating unit 34 comprises a color 
judging unit 1301, an edge detecting unit 1302, a halftone detecting unit 
5 1303, and a judging unit 1304. 

The color judging unit 1301 decides, based on the RGB signal 
input from a scanner y correction unit 2, if a pixel (or a block) of interest is 
a black (achromatic) pixel or a color (chromatic) pixel and outputs the 
result to the judging unit 1 304. To be more specific, the color judging 

10 unit 1301 decides a pixel to be achromatic when, for instance, R is 

greater than Thr 1 , G is greater than Thr 2, and B is greater than Thr 3. 
The pixel is considered to be chromatic otherwise. 

The edge detecting unit 1302 decides, based on the G signal 
input from the scanner y correction unit 2, if the pixel (or the block) of 

15 interest has an edge and outputs the result to the judging unit 1304. 
The halftone detecting unit 1303 decides, based on the G signal input 
from the scanner y correction unit 2, if the pixel (or the block) of interest 
has a halftone and outputs the result to the judging unit 1 304. The 
deciding method, for instance, may employ the technology disclosed in 

20 the article titled "Image area separating method for graphics containing 
characters and images (halftone, picture)" in Vol. J75-D-II No.1 pp. 39 to 
47, January 1992 issue of Electronic Information Communication Society, 
wherein edge detection is carried out based on the continuity of high 
density level and low density level pixels, and the halftone detection is 

25 carried out based on the number of peak pixels in a specific area. 



The judging unit 1304 decides, based on the results received from 
the color judging unit 1301, the edge detecting unit 1302, and the 
halftone detecting unit 1303, if the pixel (or the block) of interest is a 
black character/color character/picture area (achromatic)/picture area 
5 (chromatic), and outputs the result to the filter processing unit 32. 

To be more specific, if the pixel or the block is determined to be 
an 'edge' or a 'non-halftone', then the judging unit 1304 decides that the 
pixel is a 'character'. Otherwise, the pixel is a 'picture area'. This 
judgment is combined with the result of the color decision (chromatic/ 

10 achromatic). If the combination is Character' and 'chromatic', then the 
pixel is judged to be a 'color character'. If the combination is 'character' 
and achromatic', then the pixel is judged to be a 'black character'. 
Similarly, if the combination is 'picture area' and 'chromatic', the pixel is 
judged to be a 'picture area (chromatic)', and if the combination is 'picture 

15 area' and 'achromatic', the pixel is judged to be a 'picture area 
(achromatic)'. 

The second color converting unit 31 converts the RGB signal into 
an LUV signal (L is a luminance signal, UV is a chrominance difference 
signal), which is a luminance/chrominance difference signal, and outputs 
20 the LUV signal to the filter processing unit 32. The conversion from the 
RGB signal to the LUV signal is carried out based on the following 
expressions: 

L = floor{(R+2xG+B)/4} 

U = R-G 

25 V=B-G ...(4) 



where floor { } is a floor function. 

The filter processing unit 32 receives the LUV signal from the 

second color converting unit 31 , an edge amount from an edge amount 

calculating unit 23, and an image area separating signal from the image 
5 area separating unit 34. Fig. 1 0 is a block diagram of the filter 

processing unit 32 shown in Fig. 8. 

The filter processing unit 32 comprises smoothing units 81 L, 81 U, 

81V, Laplacian filters 62L, 62U, 62V, multipliers 64L, 64U, 64V, adders 

65L, 65U, 65V, and an edge enhancement amount controller 82. 
10 The smoothing units 81 L, 81 U, and 81V carry out a smoothing 

process on the LUV signal input from the second color converting unit 31 

and output the smoothed LUV signal respectively to the Laplacian filters 

62L, 62U, and 62V. Fig. 11 is a block diagram of the smoothing unit 

81L/81U/81V shown in Fig. 10. As the smoothing units 81 L, 81 U, and 
15 81V have the same hardware structure, they are represented as a 

smoothing unit 81 in Fig. 11. The smoothing unit 81 comprises a 

smoothing filter 71 and a selector 72. 

The LUV signal from the second color converting unit 31 are input 

to the smoothing filter 71 and the selector 72 in the smoothing unit 81 
20 shown in Fig. 11. The smoothing filter 71 carries out a smoothing 

process on the LUV signal received from the color converting unit 31 and 

outputs the smoothed LUV signal to the selector 72. 

The selector 72 selects, based on the image area separating 

signal input from the image area separating unit 34, either the LUV signal 
25 prior to the smoothing process (non-smoothed signal) input from the 



second color converting unit 31 or the smoothed LUV signal input from 
the smoothing filter 81 , and outputs the selected LUV signal to the 
respective Laplacian filter 62 and adder 65. To be more specific, the 
selector 72 selects the LUV signal prior to the smoothing process if the 
5 image area separating signal indicates a black character/color character, 
and the smoothed LUV signal if the image area separating signal 
indicates a picture area. 

The Laplacian filters 62L, 62U, and 62V carry out a Laplacian 
filtering process on the L, U, and V signals input respectively from the 

10 smoothing units 81 L, 81 U, and 81V, and output the Laplacian filtered L, U, 
and V signals, respectively, to the multipliers 64L, 64U, and 64V. 

The edge enhancement amount controller 82 calculates, based on 
the edge amount input from the edge amount calculating unit 23 and the 
image area separating signal input from the image area separating unit 

15 34, a luminance enhancement amount (edge_Y) and a chrominance 
difference enhancement amount (edge_UV). The edge enhancement 
amount controller then outputs the luminance enhancement amount 
(edge_Y) to the multiplier 64L, and the chrominance difference 
enhancement amount (edge_UV) to the multipliers 64U and 64V. To be 

20 more specific, the luminance enhancement amount (edge_Y) and the 
chrominance difference enhancement amount (edge_UV) are calculated 
in accordance with the expression (5) given below. 

Black character edge_Y = const, edge_UV = 0 

Color character edge_Y = 0, edge_UV = const 

25 Picture area (achromatic) edge_Y =Eout, edge_UV = 0 



Picture area (chromatic) edge_Y = 0, edge_UV = Eout 

... (5) 

where, Eout is the edge amount output from the edge amount calculating 
unit 23, and const is a value determining the degree of enhancement of 
5 the character. Normally, const is the maximum Eout value (or a value 
excluding the maximum Eout value). 

According to expression (5), for a black character, only the 
luminance is greatly enhanced and for a color character, only the 
chrominance difference is greatly enhanced. For a picture area, edge 
10 enhancement is carried out in either luminance or the chrominance 
difference in accordance with the edge amount, based on whether the 
picture area is achromatic or chromatic. 

The multiplier 64L multiplies the L signal input from the Laplacian 
filter 62L and the luminance enhancement amount (edge_Y) input from 
15 the edge enhancement amount controller 82, and outputs the product to 
the adder 65L. The multiplier 64U and 64V multiply the U signal and V 
signal input respectively from the Laplacian filters 62U and 62V with the 
chrominance difference enhancement amount (edge_UV) input from the 
edge enhancement amount controller 82, and output the products 
20 respectively to the multiplier 65U and 65V 

The adders 65L, 65U, and 65V add output from the multipliers 
64L, 64U, 64V and output from the smoothing units 81 L, 81 U, 81V, 
respectively, and output the results to the third color converting unit 33 
The third color converting unit 33 converts the LUV signal input 
25 from the filter processing unit 32 into an RGB signal in accordance with 



the expression (6) given below, and outputs the RGV signal to a color 
correction unit 3. 

G = L-floor {(U+V)/4} 

R = U+G 

5 B = V+G ...(6) 

In the expressions (5) and (6), the floor function has been used. 
However, the floor function need not necessarily be used in the space 
filter process. Instead rounding or truncating may be implemented. 
To sum up, according to the third embodiment of the present 

10 invention, the filter processing unit 32 carries out, based on the edge 
amount calculated from the CM signals and the image area signal 
calculated from the RGB signal, luminance/chrominance difference 
enhancement on the LUV signal. Consequently, pure black characters in 
which no color is included and pure color characters can be obtained. 

15 Further, the edge amount is calculated from the CM signals, as in the first 
embodiment. As a result, the edge amount in the case of color 
character-on-color background can be increased as compared to the 
case in which the edge amount is calculated from the RGB signal 
obtained after the scanner y correction process (or from the edge amount 

20 calculated from the luminance (brightness)/chrominance difference signal 
calculated from the RGB signal). 

The image processing apparatus according to a fourth 
embodiment of the present invention is explained next with reference to 
Fig. 12. Fig. 12 is a block diagram of an image processing apparatus 

25 according to a fourth embodiment of the present invention. The image 



processing apparatus shown according to the fourth embodiment has an 
image area separating unit 1401 that employs a luminance chrominance 
difference signal, namely the LUV signal, instead of the RGB signal that 
is employed by the color processing apparatus according to the third 
5 embodiment shown in Fig. 8. 

The image area separating unit 1401 carries out, based on the 
LUV signal input from a color converting unit 31 , an image area 
separation and outputs the image area separated signal to a filter 
processing unit 32. The method disclosed in Japanese Patent 

10 Laid-Open Publication No.H5-145750 may be employed as an image area 
separation method that uses the LUV signal. In this method, 
character/halftone (picture) is decided from L* signal and color/black and 
white is decided from a*b* signals of L*a*b* signal. Image area 
separation in the case of a LUV signal is also carried out in the same way 

15 as for the L*a*b* signal. 

In this way, an effect similar to the one in the third embodiment 
can be obtained even by combining with the widely known image area 
separating technology relating to the luminance chrominance difference 
signal. The image area separation and the filtering process are carried 

20 out by the same luminance chrominance difference signal. Hence, a 
common line memory can be used, thereby reducing the scale of the 
hardware requirement. 

The image processing apparatus according to a fifth embodiment 
of the present invention is explained next with reference to Fig. 13 and 

25 Fig. 14. Fig. 13 is a block diagram of an image processing apparatus 



according to a fifth embodiment of the present invention. The parts in 
Fig. 13 that are identical to those in Fig. 1 are assigned the same 
reference numerals and are not described here. However, the parts that 
are different (a fourth color converting unit 41 and an image area 
separating unit 42) in the fifth embodiment are explained here. 

The fourth color converting unit 41 converts into a CMY signal a 
scanner y-corrected RGB signal input from a scanner y correction unit 2 
and outputs the CMY signal to the image area separating unit 42 and the 
CM signal to an edge amount calculating unit 23. 

The function of the edge amount calculating unit 23 is identical to 
that in the first embodiment (Fig. 1). Hence, its description is omitted 
here. 

Fig. 14 is a block diagram of the image area separating unit 42 
shown in Fig. 13. The image area separating unit 42 comprises a color 
judging unit 901, an edge detecting unit 902, a halftone detecting unit 903, 
and a judging unit 904. 

The color judging unit 901 judges, based on the RGB signal input 
from the fourth color converting unit 41 , if a pixel (or a block) of interest is 
a black pixel (achromatic) or a color pixel (chromatic) and outputs the 
result to the judging unit 904. To be more specific, the color judging unit 
decides a pixel to be black if C is greater than Thr 1 , M is greater than 
Thr 2, and Y is greater than Thr 3. The pixel is considered to be a color 
pixel otherwise. 

The edge detecting unit 902 decides, based on the CM signal 
input from the color converting unit 42, if the pixel (or the block) of 

26 



interest is an edge and outputs the result to the judging unit 904. To be 
more specific, the edge detecting unit 902 judges by the method 
employed in the third embodiment (Fig. 9) if the C signal and the M signal 
have an edge. If an edge is detected in at least one of the C signal and 
5 the M signal, the edge detecting unit 902 outputs the result that an edge 
has been detected. If neither the C signal nor the M signal is an edge, 
the edge detecting unit 902 outputs the result indicating that no edge has 
been detected. 

The halftone detecting unit 903 decides, based on the CMY signal 

10 input from the color converting unit 42, if the pixel (or the block) of 

interest is a halftone and outputs the result to the judging unit 904. To 
be more specific, the halftone detecting unit 903 detects by the method 
employed in the third embodiment, the peak for each of the C, M, and Y 
signals and decides if it is a halftone. Even if one of the C, M or Y signal 

15 is a halftone, the halftone detecting unit 903 outputs the signal indicating 
that a halftone has been detected. Only if none of the C, M, and Y 
signals is a halftone does the halftone detecting unit 903 output the signal 
indicating no halftone has been detected. 

The judging unit 904 decides by the method employed in the third 

20 embodiment, based on the result of the color judging unit 901 , the edge 
detecting unit 902, and the halftone detecting unit 903, if the pixel (or the 
block) of interest is a black character/color character/picture area 
(achromatic)/picture area (chromatic), and outputs the result as a picture 
area separation signal to a filter processing unit 32. 

25 To sum up, in the fifth embodiment, the image area separating 



unit 42 carries out image area separation employing a CMY signal. 
Consequently, high-precision halftone detection is easily carried out. In 
other words, an original color halftone image is separated into an 
individual halftone of CMY. As the Rosetta pattern is almost negligible in 

5 the CMY signal, the peak detection of this halftone-separated signal can 
be more easily carried out as compared to image area separation of a 
RGB signal or a luminance chrominance difference signal. Therefore, 
errors relating to separation are also minimized. 

An error in deciding the color is very likely to occur in a low 

10 precision color separation RGB signal. For instance, in an original dark 
magenta (red + blue) image, not only do the R signal and B signal have 
high values because of low precision of color separation of the RGB 
signal, but the G signal also has a relatively high value. Consequently, 
the image may be incorrectly judged as achromatic. In contrast, in a 

15 high precision color separation CMY signal, if the original image is a dark 
green (cyan + yellow) image, the M and Y signals have high values, but 
the C signal has a small value. Consequently, the image is correctly 
judged as achromatic. In other words, an accurate decision if a given 
pixel is chromatic/achromatic can be made by deciding the color in a high 

20 precision color separation CMY signal. Further, since image area 
separation and edge amount calculation take place in the same CMY 
color space, a common line memory can be used, thereby reducing the 
scale of the hardware requirement. 

In the first through fifth embodiments an adaptive filtering process 

25 occurring in an RGB space, a CMY space, and an LUV space is 



explained. However, the gist of the present invention is that the edge 
amount is calculated or the image area separation is carried out from a 
signal converted in the CMY space. The filtering process, however, 
need not be confined to only the color spaces mentioned above and may 
5 include an L*a*b* color space or a YCbCr color space, etc. The filter 
processing structure (smoothing and enhancing methods) may, for 
instance, employ the technology disclosed in Japanese Patent Laid-Open 
Publication No. H1 0-421 52, Japanese Patent Laid-Open Publication No. 
H7-307869, and Japanese Patent Laid-Open Publication No. 

10 2001-24898. 

Further, in the first through fifth embodiments, an example of 
image data being read by a scanner has been shown. However, image 
data may also be received via a transmission channel such as a local 
area network (LAN). The output device may not necessarily be a printer 

15 and may be a display device such as a monitor or a storage device such 
as a hard disk. 

The image processing apparatus according to the present 
invention can be applied to a system constituted by a plurality of devices 
(for instance, a host computer, an interface, a scanner, and a printer, etc.) 

20 or to an apparatus comprising a single device (for instance, a copying 
machine, a digital multifunction product, or a facsimile machine, etc.). 

The object of the present invention can also be achieved by 
providing a storage medium that stores program codes for performing the 
aforesaid functions of the embodiment to a system or an apparatus, 

25 reads the program codes with a computer (or a central processing unit 



(CPU), a microprocessor unit (MPU), or a digital signal processor (DSP)) 
of the system or apparatus from the storage medium, and then executes 
the program. In this case, the program codes read from the storage 
medium implement the functions the program codes or the storage 
5 medium in which the program codes are stored constitutes the invention. 
The storage medium on which the program codes is stored can be a 
magnetic storage medium such as a floppy disk (FD) or a hard disk, an 
optical storage medium such as an optical disk, a magneto optical 
storage medium such as a magneto optical disk, CD-ROM, CD-R, or 

10 magnetic tape, or a semiconductor storage medium such as a 
non-volatile type memory card, ROM, etc. 

Further, besides the case where the functions of the image 
processing apparatus are implemented by executing the program codes 
read by a computer, the present invention covers a case where an 

15 operating system (OS) or the like working on the computer performs a 
part of or the entire process in accordance with the designation of 
program codes and implements the functions according to the 
embodiment. 

The present invention further covers a case where, after the 
20 program codes read from the storage medium are written to a function 
extension board inserted into the computer or to a memory provided in a 
function unit connected to the computer, a CPU or the tike contained in 
the function extension board or function extension unit performs a part of 
or the entire process in accordance with the designation of the program 
25 codes and implements the function of the above embodiments. 



As many apparently widely different embodiments of the present 
invention can be made without departing from the spirit and scope thereof, 
it is to be understood that the invention is not limited to the specific 
embodiments thereof except as defined in the appended claims. 

5 The image processing apparatus according to claim 1 comprises 

an image input unit that inputs an RGB signal corresponding to a color 
image, a first color conversion unit that converts the RGB signal input 
from the image input unit to a CMY signal, an image attribute extraction 
unit that extracts an image attribute from the CMY signal, and an 

10 adaptive image processing unit that adaptively carries out, in accordance 
with the image attributes extracted from the CMY signal, image 
processing of color image signals of the color image. Consequently, 
highly accurate image attribute can be extracted from the CMY signal that 
has a high precision of color separation and therefore an adaptive image 

15 processing can be carried out. 

In the image processing apparatus according to claim 2, the 
image attribute extraction unit according to claim 1 calculates as the 
image attribute an edge amount of the color image. Consequently, in 
addition to the effects of claim 1 , a high edge amount can be obtained in 

20 a color character-on-color background setup, thereby achieving sufficient 
edge enhancement. 

In the image processing apparatus according to claim 3, the 
image attribute extraction unit according to the claim 1 calculates as the 
image attribute an image area separating signal that separates an image 

25 area. Consequently, in addition to the effects of claim 1, errors relating 



to color judgment can be considerably reduced as image area separation 
is carried out using the CMY signal that has a high precision of color 
separation. Further, highly accurate halftone separation can also be 
carried out. 

5 In the image processing apparatus according to claim 4, the 

adaptive image processing unit according to any one of claims 1 through 
3 carries out an adaptive image processing on an RGB signal, or a 
luminance chrominance difference signal or a brightness chromaticity 
signal of the color image. Consequently, in addition to effects of any one 
10 of claims 1 through 3, the adaptive image processing of the filtering 

process can be carried out in any color space, as the CMY signal, which 
is converted in the CMY color space, is used only for extracting the image 
attribute. 

The image processing apparatus according to claim 5 comprises 
15 an image input unit that inputs an RGB signal corresponding to a color 
image, a first image attribute extraction unit that extracts a first image 
attribute from the RGB signal input from the image input unit, a first 
conversion unit that converts the RGB signal input from the image input 
unit into a CMY signal, a second image attribute extraction unit that 
20 extracts a second image attribute from the CMY signal, and an adaptive 
image processing unit that adaptively carries out, based on the first 
image attribute and the second image attribute, image processing on 
color image signals of the color image. Consequently, a highly accurate 
image attribute can be extracted from the CMY signal that has a high 
25 precision of color separation and therefore an adaptive image processing 



can be carried out. 

In the image processing apparatus according to claim 6, the first 
image attribute extraction unit according to claim 5 calculates as the first 
image attribute an image area separating signal that separates an image 
5 area, and the second image attribute extraction unit calculates as the 
second image attribute an edge amount of the color image. 
Consequently, in addition to the effects of claim 5, a high edge amount 
can be obtained in a color character-on-color background setup, thereby 
achieving sufficient edge enhancement. 

10 In the image processing apparatus according to claim 7, the 

adaptive image processing unit according to the claim 5 or 6 adaptively 
carries out image processing on the RGB signal or a luminance 
chrominance difference or a brightness chromaticity signal of the color 
image. Consequently, in addition to the effects of claim 5 or 6, the 

15 adaptive image processing of the filtering process can be carried out in 
any color space, as the CMY signal that is converted in the CMY color 
space is used only for extracting the image attribute. 

The image processing apparatus according to the claim 8 
comprises an image input unit that inputs an RGB signal corresponding to 

20 a color image, a first conversion unit that converts the RGB signal into a 
CMY signal, a second conversion unit that converts the RGB signal into a 
luminance chrominance difference signal or a brightness chromaticity 
signal, a first image attribute extraction unit that extracts a first image 
attribute from the luminance chrominance difference signal or the 

25 brightness chromaticity signal, a second image attribute extraction unit 



that extracts a second image attribute from the CMY signal, and an 
adaptive image processing unit that adaptively carries out, based on the 
first image attribute and the second image attribute, image processing on 
color image signals. Consequently, highly accurate image attribute can 
5 be extracted from the CMY signal that has a high precision of color 
separation and therefore an adaptive image processing can be carried 
out. 

In the image processing apparatus according to claim 9, the first 
image attribute extraction unit according to claim 8 calculates as the first 

10 image attribute an image area separating signal that separates an image 
area, and the second image attribute extraction unit calculates as the 
second image attribute an edge amount of the color image. 
Consequently, in addition to the effects of claim 8, a high edge amount 
can be obtained in a color character-on-color background setup, thereby 

15 achieving sufficient edge enhancement. 

In the image processing apparatus according to claim 10, the 
adaptive image processing unit according to claim 8 or 9 adaptively 
carries out image processing of the RGB signal or a luminance 
chrominance difference signal or a brightness chromaticity signal of the 

20 color image. Consequently, in addition to the effects of claim 8 or 9, the 
adaptive image processing of the filtering process can be carried out in 
any color space, as the CMY signal that is converted in the CMY color 
space is used only for extracting the image attribute. 

In the image processing apparatus according to claim 11, the 

25 second image attribute extraction unit according to claim 6 or 9 calculates 



as the second image attribute the edge amounts of a C signal or an M 
signal of the CMY signal. Consequently, in addition to the effects of 
claim 6 or 9, only the C signal and M signal are employed for calculating 
the edge amount value, thereby enabling reduction in the scale of the 
5 hardware. 

In the image processing apparatus according to claim 12, the first 
color conversion unit according to any one of claims 1 through 11 varies a 
conversion coefficient for conversion of the RGB signal to the CMY signal 
in accordance with an original image type mode. Consequently, 

10 appropriate conversion coefficient can be used for original images such 
as a print image and photographic print image that have greatly differing 
hue characteristics, thereby making the color separation precision high. 

In the image processing according to claim 13, the original image 
type mode is a print image mode, a photographic printing paper image 

15 mode, or a photocopy image mode (generation mode). Consequently, in 
addition to the effects of claim 12, the color separation precision of the 
CMY signal in the print image mode, the photographic printing paper 
image mode, or the photocopy image mode (generation mode) can be 
increased. 

20 The image processing method according to claim 14 comprises 

the steps of inputting an RGB signal corresponding to a color image, 
converting the RGB signal into a CMY signal, extracting an image 
attribute from the CMY signal, and an adaptive image processing of color 
image signals in accordance with the extracted image attribute. 

25 Consequently, highly accurate image attribute can be extracted from the 



CMY signal that has a high precision of color separation and therefore an 
adaptive image processing can be carried out. 

The program according to claim 15 that causes a computer to 
execute the steps of inputting an RGB signal corresponding to a color 
image, converting the RGB signal into a CMY signal, extracting an image 
attribute from the CMY signal, and an adaptive image processing of color 
image signals in accordance with the extracted image attribute. 
Consequently, a highly accurate image attribute can be extracted from 
the CMY signal that has a high precision of color separation and 
therefore an adaptive image processing can be carried out. 

The present document incorporates by reference the entire 
contents of Japanese priority document, 2002-274107 filed in Japan on 
September 19, 2002. 

Although the invention has been described with respect to a 
specific embodiment for a complete and clear disclosure, the appended 
claims are not to be thus limited but are to be construed as embodying all 
modifications and alternative constructions that may occur to one skilled 
in the art which fairly fall within the basic teaching herein set forth. 
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